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ABSTRACT 


We  define  dlacrete  time  sequential  games  which  are  multiperaon  Markov 


decision  processes.  The  extant  theory  is  sketched  and  compared  with 
our  assessment  of  research  needs  in  dynamic  models  of  oligopoly  and  other 
competitive  resource  allocation  problems.  A special  class  of  economic 
survival  games  is  noted. 


1.  INTRODUCTION 

An  oligopolistic  market  is  one  with  only  a few  firms  who  supply  the 
commodity  being  purchased.  Oligopoly  theory,  until  recently,  evolved 
without  regard  to  the  institutional  details  encountered  in  specific  mar- 
kets and  without  addressing  the  role  played  by  time.  Oligopoly  models 
were  treated  statically,  or  at  best,  conversationally  dynamically.  How- 
ever, dynamic  oligopoly  models  have  been  analyzed  with  increasing  frequency 
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in  recent  years  and  some  of  these  analyses  are  responsive  to  institutional 
details. 

Here  we  compare  the  literature  on  dynamic  models  of  oligopoly  with 
our  construal  of  the  objectives  of  oligopoly  theory.  We  use  discrete 
time  sequential  games,  sometimes  called  "stochastic  games,"  as  a canonical 
form  in  which  to  discuss  the  issues.  The  stochastic  game  model  encom- 
passes many  Interesting  oligopoly  models  and  it  seems  to  offer  an  appro- 
priate level  of  generality  to  address  research  needs.  Incidentally,  we 
do  not  believe  that  there  is  any  importance  to  economic  theory  associated 
with  the  distinction  here  between  continuous  and  discrete  time  models, 
l.e.,  between  stochastic  games  and  differential  games.  In  principle, 
the  discussion  could  be  couched  in  terms  of  continuous  time  models  instead 
of  stochastic  games. 

We  believe  that  the  primary  objective  of  oligopoly  theory  is  to  provide 
an  understanding  of  pricing  and  resource  allocation  over  time  in  large 
firms  and  the  consequent  market  behavior  of  such  firms.  We  begin  by 
enumerating  some  issues  Involving  dynamics  that  are  inherent  in  this 
goal.  We  sketch  a general  stochastic  game  model  and  use  the  model  to 
address  the  task  of  constructing  satisfactory  dynamic  oligopoly  models. 

This  effort  in  part  becomes  a specification  of  research  needs  and  oppor- 
tunities in  stochastic  game  theory  and  oligopoly  theory.  At  this  stage 
in  the  development  of  both  subjects,  it  is  useful  to  identify  problems 
rather  than  only  describe  past  accomplishments.  Section  5 cites  specific 
recent  results,  and  Section  6 presents  a blending  of  problems  In  optimi- 


zation and  survival. 
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. DYNAMICAL  ISSUES  IN  OLIGOPOLY 

What  are  some  characteristics  of  the  dynamics  of  pricing  and  resource 
allocation  in  large  firms  and  their  consequent  market  behavior?  Here, 
ve  mention  three  kinds  of  problems.  Firstly,  there  are  the  dynamics  of 
the  composition  of  the  set  of  firms  in  the  market.  This  "entry  and  exit" 
problem  in  oligopoly  is  the  subject  of  current  research  but  most  analyses 
have  either  been  static  or  ignored  the  multiplicity  of  "players"  in  such 
games.  A closely  related  problem  is  how  to  distinguish  "competition  among 
the  few"  from  "competition  among  the  many."  The  modeling  issue  is  how 
large  must  a market  become  in  order  for  game-like  individual  behavior 
to  become  unimportant.  Secondly,  in  a given  oligopolistic  market,  why 
do  prices  fluctuate  as  they  do?  In  most  markets,  the  prices  fluctuate 
more  slowly  than  the  prices  of  the  factors  comprising  the  inputs  in  the 
production  process.  This  phenomenon  of  "sticky  prices"  is  widely  recog- 
nized but  has  hardly  been  analyzed  in  a dynamic  oligopoly  model.  Lastly, 
in  some  oligopolistic  markets,  there  is  one  firm  that  acts  as  a leader 
in  changing  the  price  level.  Why?  Why  is  there  price  leadership  behavior 
in  some  markets  but  not  in  others?  Why  might  a firm  act  passively  as 
a follower  under  some  conditions  but  bolt  the  pack  under  other  conditions? 

Another  collection  of  dynamical  issues  concerns  the  role  of  infor- 
mation in  market  behavior.  How  do  firms  tacitly  communicate  their  objec- 
tives, strategies,  and  threats  to  one  another?  How  do  divisions  of  a 
large  firm  conaunlcate  with  one  another  so  that  their  decentralized  actions 
are  mutually  supportive  of  the  overall  goals  of  the  firm.  This  is  the 
general  problem  of  managerial  control.  Furthermore,  how  do  accounting 
conventions  affect  firm  and  market  behavior?  Technically,  this  question 
can  be  posed  in  terms  of  alternative  aggregations  of  information.  Lastly, 
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what  are  tne  effects  of  imperfections  In  Information,  particularly  those 
due  to  delays  in  transmission  of  Information?  Little  progress  has  been 
made  on  a general  treatment  of  this  last  issue  and  the  prior  one  has 
been  analyzed  in  some  detail  only  in  static  models  (Team  Theory). 

What  are  the  effects  of  market  size?  Host  facets  of  this  issue 
are  not  particularly  dynamical  in  nature  but  we  should  know  how  to  analyze 
them  in  dynamic  models.  As  one  example,  what  is  the  effect  on  product 
quality  of  the  number  and  size  of  firms  that  are  competing?  An  issue 
that  is  primarily  dynamical  is  the  dependence  of  the  number  of  firms  in 
the  market  upon  the  time  rate  at  which  information  spreads,  and  vice 


versa. 


Preference  structures  have  been  treated  somewhat  incidentally  in 
oligopoly  theory.  Important  research  on  intertemporal  preference  order- 
ings is  currently  occurring  (Kreps  & Porteus,  forthcoming)  for  models  of  individual 
decision  making  over  time.  Comparable  investigations  of  dynamic  multi- 
person  decision  models  have  not  yet  begun.  The  situation  becomes  even 
more  complicated  if  we  construct  "behavioral  models  of  the  firm"  (Cyert  & March, 
1963,  Williamson,  1975)  which  discard  the  notion  of  a single  monolithic 
"decision  maker"  making  all  the  decisions  in  each  firm.  The  models  in 
"Team  Theory,"  for  example,  can  be  construed  as  noncooperative  games 
amongst  players  having  the  same  preference  ordering  over  outcomes  but 
differing  in  the  information  and  the  actions  available  to  each.  We  have 
yet  to  see  an  investigation  of  sequential  models  of  this  kind.  Lastly, 
the  dynamic  oligopoly  models  analyzed  thus  far  are  predicated  on  a scalar 
objective  such  as  each  firm's  discounted  operating  profit.  However, 
various  economists  argue  that  managers  in  firms  behave  as  if  they  were 
maximizing  vector  objectives.  Components  other  than  profit  might  include 
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rate  of  growth  In  ulu,  number  of  employees,  ehsre  of  the  msrket  end 
survival.  An  Important  first  step  has  been  taken  in  the  analysis  of 
sequential  games  with  vector  payoffs  (Henlg,  1978)  but  this  general 
theory  has  yet  to  be  applied  to  a dynamic  oligopoly  model. 

He  now  turn  to  some  Issues  of  constructing  satisfactory  dynamic 
oligopoly  models.  The  canonical  form  of  a general  stochastic  gams  will 
be  useful  for  that  purpose.  The  next  section  briefly  defines  a stochas- 
tic game  and  enumerates  some  notions  of  the  "solution"  of  such  a model. 

3.  STOCHASTIC  GAMES 

Let  I be  a set  of  players.  S a set  of  states,  and  A*  a set 

of  actions  available  to  player  i c I when  the  process  is  in  state  s c S . 

These  sets  are  assumed  to  be  nonempty.  The  composite  action  of  all  the 

players,  when  the  process  is  in  state  s , must  be  an  element  of 

C - X A*  . We  write  a • (a*)  c C . An  outcome  of  a stochastic 
• id  8 8 

game  is  a sequence  a^,  a^,  s2,  a2,  •••  where  at  c Cg  for  all  t . 

Let  W - ((s,a)  : a e C#,  s e S)  . 

The  dynamics  are  determined  by  the  decision  rules  used  by  the  players 
to  choose  their  actions  and  by  a collection  {q(*|s,  a)  : (s,a)  c W) 
of  probability  measures  on  Bg  , the  Borel  subsets  of  S . For  any 
period  t and  H t Bg  , if  >t  * 8 and  a(  ■ a then  q(H|a,  a)  is 
the  probability  that  at+1  e H . 

A two-person  sero-sum  matrix  game  is  a special  case  of  a stochastic 
gams  where  S is  a singleton.  It  is  easy  to  see  that  in  such  a game, 
in  general,  one  amy  wish  to  admit  randomised  strategies.  This  complicates 
the  measurability  and  lntagrabllity  issues  which  are  already  Imbedded 
in  the  one  person  stochastic  game,  namely  the  Markov  decision  process. 
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Our  exposition  suppresses  these  Issues  which  are  the  subject  of  some 
current  research  on  stochastic  games.  The  interested  reader  should  resd 
the  fine  survey  by  Parthasarathy  and  Stern  (1977)  and  the  neat  recent 
paper  by  Uhltt  (1977). 

With  the  preceding  caveat,  let  n1  denote  the  set  of  player  i's 

nonant lclpatlve  decision  rules  (Including  rules  that  are  history  dependent 

and  randomized)  for  choosing  a*  , for  each  t , on  the  basis  of  the 

outcome  to  date,  namely  s^,  a^,  ...,  s^,  *t_p  8t  • Th«  stationary 

policies  are  particularly  Interesting  decision  rules.  Let  D*  be  the 

set  of  probability  measures  on  the  Borel  subsets  of  A*  . An  element  of 

D*  can  be  used  to  choose  a randomized  action  when  the  game  is  in  state 

s . Let  A*  ■ X D1  , 4 ■ X 41  , and  n ■ Xn^  . An  element  of 
scS  3 icl  lei 

it  is  a policy.  A policy  y e n is  stationary  if  there  exists  6 e A 

such  that  y ■ (6.  6,  6,  ...  ) so  “ <5(st)  for  all  t . We  write 

Y ■ 6°°  in  this  case.  Let  A°°  denote  the  subset  of  stationary  policies 

in  it  . Finally,  it  is  convenient  to  represent  any  yen  as  (y*.  y~*) 

where  y~*  e nr*. 

Jj*i 

There  has  been  some  research  on  the  ergodic  properties  of  {(st,  at)} 
induced  by  stationary  policies  (cf.  Sanghvl  & Sobel,  1976,  Sanghvl,  1976) 
but  most  literature  concerns  real-valued  payoff  functions.  Let  ri(s,a) 
denote  the  (expected)  immediate  reward  to  player  i in  any  period  t 
if  the  state  at  la  s and  the  composite  action  a(  is  a e Cg 

Let  be  player  i's  single  period  discount  factor  and  let 
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(1) 


V1(y|«)  - l •5"lr1(«t.  at) 

t-1  1 c 1 

v1(y|«)  - EV1(y | •) 


denote  the  total  dlacounted  payoff  and  Its  expectation  when  yen  is 
the  policy  and  s^  ■ s is  the  initial  state.  Some  literature  concerns 
the  average  payoff  per  period  rather  than  the  discounted  payoff  but  the 
latter  is  more  appropriate  for  oligopoly  and  other  open  (or  partial  equi- 
librium) economic  models. 

A policy  yen  is  said  to  be  an  equilibrium  point  relative  to 
HCS  iff 


(2)  v^CyIs)  • sup{v*(p,  y *)  : P e . s e H , i e I . 

We  say  simply  that  y is  an  equilibrium  point  if  it  is  an  equilibrium 
point  relative  to  S . An  equilibrium  point  relative  to  H is  non- 
collualvely  optimal  for  every  initial  state  in  H and  every  player. 
Shapley  (1953),  in  a magnificent  early  paper,  established  existence  of 
an  equilibrium  point  amongst  stationary  policies  in  a two-player  model 

i j n 

with  U A a finite  set  for  each  player  and  r (•,•)  + r (•,*)  = C . 
scS 

More  general  existence  results  concern  nonzero  sum  games  played  by  more 
than  two  players  (Rogers,  1969,  Sobel,  1971,  Parthasarathy  & Stern,  1977, 
Whitt,  19  77).  Also, Henlg  (1978)  has  recently  established  existence  of 
an  equilibrium  point  for  games  where  rV,’)  is  vector-valued. 
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4.  MODELING  ISSUES 

We  have  observed  that  the  extant  theory  fails  to  explain  why  price 
leaderahlp  occurs  and  which  firms  are  likely  to  be  followers  while  others 
are  leaders.  More  generally,  there  is  no  satisfactory  sequential  analogue 
to  "cooperative"  theory  for  static  gases.  The  prinitive  element  in  most 
of  the  cooperative  static  theory  is  the  coalition,  namely  a subset  of 
the  players  who  Join  together  for  mutual  benefit.  However,  a satisfactory 
dymamic  theory  must  admit  changes  in  coalition  composition  as  time  passes 
but  the  present  theory  does  not  include  this  feature. 

Another  isodeling  issue  stems  from  the  embarrassment  of  riches  provided 
by  the  else  of  the  set  of  equilibrium  points.  It  is  known  that  the  sixe 
of  this  set  increases  as  information  conditions  in  a game  proliferate 
(cf,  Dubey  and  Shubik,  1979),  Therefore,  oligopoly  models  that  strive  to 
include  the  design  of  information  systems  and  managerial  control  may  Induce 
distressingly  many  equilibrium  points.  The  problem  is  to  decide  which 
one,  more  generally  which  subset,  is  the  appropriate  object  for  analysis. 

We  believe  that  the  solution  to  this  problem  should  vary  depending  upon 
the  context  which  motivates  the  model.  In  other  words,  behavioral  con- 
siderations and  Institutional  details  should  direct  our  definition  of 
"the  appropriate  object  for  analysis." 

It  has  already  been  mentioned  that  no  satisfactory  canonical  model 
exists  to  analyse  the  effects  of  imperfections  in  information  due  to 
delays  in  transmission.  Indeed,  the  intricacy  of  the  analysis  in  a re- 
latively simple  case  analysed  by  Scarf  and  Shapley  (1957)  la  alarming. 

We  doubt  that  a Bayesian  approach  is  appropriate  here  although  one  of  us 
has  explored  this  elsewhere  (Sanghvi  and  Sobel,  1976).  The  extant  theory 
of  stochastic  games  would  oblige  us  to  assume  that  each  firm  knows  the 
prior  distribution  held  by  every  other  firm. 


Careful  modeling  of  many  Industries  leads  to  the  explicit  Inclusion 


of  bankruptcy  conditions  in  a model.  Such  conditions  exemplify  "exit 
fees"  In  the  class  of  Harkov  decision  processes  called  stopping  problems. 
There  are  several  interesting  qualitative  results  concerning  the  structure 
of  optimal  policies  in  stopping  problems.  As  yet,  there  is  no  comparable 
theory  for  "stopped  sequential  games."  The  payoff  to  oligopoly  theory 
from  developing  such  a theory  might  include  a deeper  understanding  of 
the  effects  of  alternative  bankruptcy  laws  and  the  dynamics  associated 
with  the  entry  and  exit  of  firms  from  an  Industry.  One  of  us  has  sug- 
gested  a class  of  "Games  of  Economic  Survival"  to  pick  up  the  ruin  pos- 
sibilities (cf.  Section  6,  Shublk,  1958,  Shubik  & Thompson,  1959). 

This  list  of  modeling  issues  is  necessarily  brief  and  we  have  not 
discussed  some  pertinent  material.  Aumann  (1959)  has  developed  results 
for  "supergames."  A supergame  is  a sequence  of  static  games  in  which  the 
nature  of  the  static  games  is  not  contingent  on  players'  past  actions.  The 
case  of  the  same  static  game  at  each  point  (in  the  sequence)  has  been 
investigated  more  than  any  other.  This  case  is  a stochastic  game  with 
|s|«  1.  Friedman  (1977)  analyzes  this  case  in  oligopoly  models.  He  focuses 
on  "reaction  function"  strategies;  each  player's  present  decision  is 
contingent  on  the  opponent's  preceding  decision.  Such  decision  rules 
Induce  a stochastic  game  in  which  S is  the  set  of  players'  possible  single 
game  decisions.  Recently,  Rosenthal  (forthcoming)  has  investigated  sequences 
of  games  with  varying  opponents.  His  point  of  view  may  be  useful  for 
construction  of  dynamic  models  of  entry  and  exit  in  oligopoly.  Shefrin 
(1978)  has  Interesting  results  for  dynamic  market  games  with  Incomplete 


information 
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5.  SPECIFIC  RESULTS 

Stochastic  |mm  models  of  oligopoly,  even  with  the  limitations  enum- 
erated above,  are  forbiddingly  complex.  Nevertheless,  some  progress 
has  been  made  cither  by  reducing  the  potential  complexity  or  by  building 
a model  for  a particular  kind  of  Industry  and  then  posing  correspondingly 
special  questions.  Flatly,  ve  discuss  the  reduction  of  complexity. 

Stochastic  game  models  sre  difficult  to  analyze  because  the  number 
of  players  Is  greater  than  one,  so  the  players  Interact  with  one  another, 
and  because  the  game  process  extends  over  time  and  each  player  indulges 
in  a variety  of  Intertemporal  tradeoffs.  Several  writers  (Lippman, 

1977  and  its  references)  have  suppressed  the  complexity  due  to  the  Inter- 
action of  firms  by  analyzing  models  of  leader-follower  behavior  where 
the  identities  of  the  leader  and  followers  are  known  at  the  outset. 

The  problem  is  then  the  selection  of  an  optimal  dynamic  policy  by  the 
leader  and  this  latter  problem  is  a (one  person)  Markov  decision  process 
which  Is  much  less  complex  than  a stochastic  game. 

Another  suppression  of  complexity  has  been  obtained  by  preserving 
a multiplicity  of  players  (firms)  but  reducing  the  original  dynamic  game 
to  a static  game.  Specifically,  an  equilibrium  point  of  a stochastic 
game  is  said  to  be  myopic  if  It  consists  of  the  ad  inf ini  turn  repetition 
of  an  equilibrium  point  of  a static  game.  The  principal  sufficient  con- 
ditions (Sobel,  1978),  satisfied  by  various  dynamic  oligopoly  models, 
are: 

(3a)  for  each  i c I and  (s.a)  e W , ri(s,a)  depends 

addltlvely  on  the  state  s and  action  a , i.e., 

there  are  functions  K1  and  L1  such  that 

r*(s,a)  - Ki(a)  + L4(s)  ; 
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(3b)  transition  probabilities  depend  on  the  actions  taken 

but  not  on  the  state  from  which  transition  occurs,  l.e., 


q(H| s,  a)  ■ p(H | a)  for  all  H e and  (s,a)  e W ; 


(3c)  suppose  the  static  game  r , defined  below,  has  an 

equilibrium  point  aA  in  pure  strategies  and  let 

S*  ■ is  : s t S,  a*  c C } . Then  p(H|a*)  ■ 1 for 

s 

all  H e B having  S*  C H , i.e.  if  sn  e S*  then 
a*  is  repeatable  a<i  infinitum  (with  probability  one) . 

Let  £(a)  be  a random  variable  with  the  measure  p(»|a)  in  (3b).  Then  I 

is  the  set  of  players  in  the  static  Nash  game  T,  player  i's  piyoff 

function  is  Ki(a)  + B.E[L1(C(a) ) ] , a c (j  A1, 

1CI  i i 

and  player  i has  available  the  set  of  moves  A » U A , If  a4 

seS 

is  randomized  then  there  is  an  assumption  comparable  to  (3c).  It  follows 
from  (3)  that  at  * aA  for  all  t is  an  equilibrium  point  [in  the  sto- 
chastic game  sense  of  (2)]  relative  to  S*  . 

Numerous  Markov  decision  processes  in  the  literature  satisfy  (3) 
but  the  myopia  of  their  optimal  policies  was  either  overlooked  or  deduced 
by  special  and  sometimes  intricate  arguments.  Also,  various  oligopoly 
models  satisfy  (3).  Kirman  and  Sobel  (1974)  assume  that  firms  make  produc- 
tion and  pricing  decisions  each  period  and  they  have  linear  production  costs 
and  arbitrary  single-period  inventory-related  costs.  The  oligopoly  model  in 
Sobel  (1977)  focuses  on  advertising  decisions.  It  is  assumed  there  that  each 
firm's  demand  each  period  is  a random  variable  whose  distribution  depends 
on  all  firms'  "goodwill."  The  goodwill  is  an  exponentially  weighted 
moving  average  of  past  amounts  spent  on  advertising.  Myopia  has  been 
applied  to  other  oligopoly  models  where  the  competition  involves  expen- 
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dltures  on  research  and  development,  expansion  of  capacity,  and  the 
harvesting  of  Interacting  fish  species  In  a coastal  fishing  Industry. 

6.  GAMES  OF  ECONOMIC  OR  SOCIAL  SURVIVAL 

The  goals  of  profit  maximization  or  cost  minimization  are  present 
in  many  economic  ”x>dels.  Games  of  survival,  as  characterized  by  Shapley 
(1953),  stress  the  binary  outcomes  of  survival  or  not.  Yet  in  many  social, 
ecological  and  economic  processes  the  goals  include  both  survival  and 
optimization  of  the  quality  of  life  for  the  survivor. 

Below  we  describe  a general  class  of  games  of  social  or  economic 

I 

survival.  With  notational  changes,  they  can  be  recast  as  stochastic 
games. 

An  n person  game  of  economic  survival  is  described  as  follows  by: 

«i(t)  ; wj  ; bJ  ; sj  ; ; and  V1  , 


where : 

® ^ “ 1*  •••,  n are  the  single  period  payoffs  faced  by  the 

players  at  time  t . They  depend  on  actions  described  below  and  will 


I 

! 


in  general  depend  upon  time. 

i “ 1»  • • • , n and  t ■ 1,  2,  ...  are  the  wealths  of  the 
players  at  the  start  of  time  t . Initial  assets  W*  and  are  given 

as  parameters. 

B are  the  ruin  conditions,  bankruptcy  levels  or  "absorbing  barriers" 
for  the  player;  i.e.,  if  the  assets  (or  strength  or  viability)  of  a player 
i drop  to  below  B*  , that  individual  is  out  of  the  game. 

S1  are  the  survival  values:  i.e.,  if  individual  i is  the  sole 
survivor  in  the  game,  S is  the  present  value  of  the  remaining  one 
person  game. 


r 


L*  are  the  liquidation  values.  If  an  individual  i is  ruined, 


he  may  atlll  have  residual  assets  at  the  point  of  ruin.  The  value  of 
these  assets  is  given  by  L1  . 

¥*  are  discount  factors.  We  assume  that  each  individual  has  a 
discount  factor  on  future  consumption.  The  could  be  dependent  upon 

the  age  of  the  individual,  thus  reflecting  life  cycle  considerations. 

T is  the  time  at  which  bankruptcy  (if  any)  occurs: 

T - inf it  : (wj,  W2)  i (B1,  B2) } . 

V1  is  the  payoff  function  to  player  i . It  cannot  be  fully  spe- 
cified until  the  strategies  and  the  relationship  among  Income,  consumption, 
and  survival  are  specified. 

Two  versions  are  given,  the  game  where  pure  survival  is  the  goal 
and  the  game  where  the  maximization  of  expected  discounted  consumption 
(or  utility  $*(•)  of  consumption)  is  optimized. 

At  the  start  of  any  time  t an  individual  i has  W*  . A Markov 
strategy  by  an  individual  i is  a plan  for  the  selection  of  an  invest- 

i 

ment  amount  x*  and  a consumption  amount  bj;  dependent  upon  Wt 

- (wj w£)  . 

W^+1  - 5t[W^  + a1(xJ,  ....  x")  -b£-x£] 

where  0 < x*  + b*  < W*  and  ^ •••  are  Independent  and  identically 

distributed  random  variables. 

Pure  Survival 


V1  - 1 if  wj  > B1  for  t - 1,  2,  ...  , 
■ 0 otherwise. 


3 Q 


— • — >•  — — 


MttManwii 


...  - - 


Pur*  Consumption  Optimisation 


j • « t-1  . . 

v - £ Or1)  ♦i(b1) 

t-i 


wj  > B1  , t-1 - 

and  game  continues  indefinitely* 


T < j i i T . W >B  i t—  1,  ...»  T 

I (y  ) ♦1(bp  + (y1)  s1  , 1 

t-0  and  game  continues  until  T. 

I i t_1  i i i T i W1  > B1  , t - 1 T-1  , 

l (y  ) ♦ (bp  + (y1)  L J k 

t-1  < B*  and  game  .continues 


until  T-1. 


For  either  criterion,  let  1 Indicate  which  player  (if  either) 


is  ruined: 


2 

Then,  for  either  criterion,  consider  the  vector  (V  , V , T,  I)  . The 
adoption  of  a policy  by  the  players  induces  a (joint)  probability  dis- 
tribution of  this  vector  and  we  may  compare  the  distributions  induced 
by  alternative  policies.  An  obvious  comparison  is  according  to 
v1  - E(V1)  . For  example,  in  the  pure  survival  criterion, 
v1  - PfV1  ■ 1}  - P(I  >>  i}  . Although  we  shall  not  pursue  the  matter 
here,  the  two  criteria  can  be  treated  in  a unified  manner  by  first  de- 
fining an  appropriate  stochastic  game. 


6.1.  A "Guns  or  Butter"  Example 


A two  player  example  illustrates  the  tradeoff  between  consumption 
and  survival.  Let  b^  and  x£  denote  player  l's  consumption  and  Investment 
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In  period  t and  let  d£  and  yt  denote  the  same  amounts  for  player  2. 
Let 

0,1(0  " \ t y;  if  *t  + yt  > 0 

- 0 If  xt  • yt  - 0 


« (O  " A-  ~~  if  x + y > 0 

t yt 


- 0 if  xt  - yt  - 0 


Let  wj  - M ; W2  - M ; B1  - B2  - L1  - L2  - 0 , S1  - S2  - A/(l-y)  ; 

ti(c)  - c ; y1  - y2  m y where  0 < y < 1 . Say  b*  - bt  and  b2  - dt 

If  the  goals  are  pure  survival  then  x£  - yt  • bfc  - d - 0 gives 

Mt+1  " ^tMt  > ® * mt+i  " ^tmt  > 0 where  > 0 is  a random  variable. 

If  the  goals  are  maximization  of  expected  consumption  then  if  a 
solution  with  joint  survival  is  feasible,  player  1 wishes  to 


b(  > 0 , xt  0 


subject  to  0 _<  bt,  0 <_  xt> 


and 


H»i  ■ i, 


"t  - b,  + * 


and  player  2 wishes  to 


xt  +yt 


dfyt 


» . t-1 

E l CO  d, 
t-1  c 
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subject  to  0 <_  dt,  0 <_  yt, 

dt  + yt  < »t 

and 


! 


; 


Let  u - E(Ctl.  If  Vw  1 1 and  P{^  > fvi/2}  - 1 (for  which  P{£  _>  1/2}  - 
1 is  sufficient)  then  we  can  show  that  there  is  a myopic  equilibrium  point 
with  respect  to  {(M1,m1);  (M^u^)  > ^liAMd,!)}  given  by 
xt  ■ yt  ■ yAY/4,  for  t ■ 1,  2,  ... 

bt  - dt  - A(2Ct_1  - ¥y)/4,  for  t - 2,  3,  ... 

bl  - Mx  - yAY/4,  dx  - mx  - yaV/  4 


and  expected  payoffs  are: 

°0 

v1  - M - AyY/4  + Z 4't-1(2^  - Yy)A/4 

t-2  Z~L 

- ML  + Ayf/IAa-y)] 
v2  - m1  + Ay4'/[4(l-4')]. 


If  P{£^  < ^y/2)  > 0,  or  (M^,m^)  VyA/Add)  » or  4*y  > 1 then  the  analysis 
and  solution  become  complicated. 

The  "net  earnings"  or  gains  from  competition  are  given  by  the  terms 


These  portray  the  resource  struggle  or  the  "battle  conditions."  The 
payoffs  Involve  only  the  bf  , i.e.,  the  resources  drawn  off  for  con- 

sumption. 
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